MEMORANDUM May 3, 2016 


TO: Darryl Williams 
Chief School Officer, School Leadership 


FROM: Carla Stevens 
Assistant Superintendent, Research and Accountability 


SUBJECT: TEACHER APPRAISAL AND DEVELOPMENT SYSTEM END-OF-YEAR 
REPORT, 2014-2015 


HISD implemented the Teacher Appraisal and Development System (TADS) in 2011 to provide 
teachers, principals, and district officials the information they need to improve instructional 
practice, to inform staffing decisions, and to ensure every student receives effective teaching. 
This report documents teacher appraisal outcomes from the 2014-2015 school year with 
historical data from the program’s inception since 2011-2012. In addition, teacher retention and 
teacher movement between schools is explored. Finally, teacher performance, by experience 
and new hire subgroups, is more closely examined at Improvement Required (IR) schools and 
Met Standard schools. 


Key findings include: 

e The 2014-2015 proportion of effective teachers overall was the highest since TADS was 
introduced in 2011-2012, at 65 percent; combined with highly effective it was 85 percent. 

e The percentage of teachers receiving a Student Performance rating has risen from year to 
year, from a low of 35 percent in 2012-2013 to 43 percent in 2014-2015. 

e The majority of teachers who were retained in 2015-2016 received an effective or highly 
effective summative rating in 2014-2015, while approximately 12 percent of those who were 
retained received a needs improvement or ineffective rating. Conversely, a higher proportion 
(31%) of exiting teachers had needs improvement or ineffective ratings. 

e IRschools have higher proportions of ineffective and needs improvement-rated teachers 
than Met Standards schools. New teachers at IR schools were almost twice as likely to be 
rated needs improvement or ineffective than new teachers at schools that met standards 
(54% compared to 31%). 


Should you have any further questions, please contact me at 713-556-6700. Further distribution 
of this report is at your discretion. 
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Attachment 


cc: Gloria Cavazos 
Andrew Houlihan 
Emile Fair 
Jeffrey McCanna 
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Teacher Appraisal and Development System 
End-of-Year Report, 2014-2015 


Executive Summary 


Evaluation Description 

The Houston Independent School District (HISD) launched the Effective Teachers Initiative in 2010 in order 
to provide every student in HISD with excellent instruction. As part of this initiative, HISD implemented the 
Teacher Appraisal and Development System (TADS) in 2011 to provide teachers, principals, and district 
officials the information they need to improve instructional practice, to inform staffing decisions, and to 
ensure every student receives effective teaching. This report documents teacher appraisal outcomes from 
the 2014-2015 school year with historical data from the program’s inception since 2011-2012. Teacher 
appraisal outcomes are summarized by each appraisal component — instructional practice, professional 
expectations, and student performance. Each appraisal component is then examined according to select 
teacher and campus level variables, including school academic level, accountability ratings, and teacher 
characteristics. In addition, teacher retention and teacher movement between schools are explored 
according to appraisal ratings, school location, and teacher experience level. Finally, teacher performance, 
by experience and new hire subgroups, is more closely examined at Improvement Required (IR) schools 
and Met Standard schools. 


Highlights 

e The 2014-2015 proportion of effective teachers overall, 65 percent, was the highest since TADS was 
introduced in 201 1—2012. When combined with highly effective teachers the proportion was 85 percent. 

e The proportion of core subject teachers rated effective increased 10 percentage points over the prior 
year, from 55 percent in 2013-2014 to 65 percent in 2014-2015, while the proportion of needs 
improvement and ineffective-rated core teachers fell from 23 percent to 16 percent in the same time 
period. 

e Even though the majority of new teachers were rated effective (59%), new teachers overall were more 
than three times more likely to be rated as needs improvement or ineffective in their summative rating 
compared to their more experienced colleagues (88% compared to 12% for other experience groups). 

e The percentage of teachers receiving a Student Performance (SP) rating has risen from year to year, 
from a low of 35 percent in 2012-2013 to 43 percent in 2014-2015. The percentage of Level 4 SP 
ratings has increased each year, and in 2014-2015 was 35 percent of all SP ratings. 

e The use of Student Progress and Student Attainment, which make up three out of the five SP measures, 
as an SP rating component increased more than threefold, from 502 teachers in 2013-2014 to 1,732 
teachers in 2014-2015. 

e The majority of teachers who stayed in the district in 2015-2016 received an effective or highly effective 
summative rating in 2014-2015, while approximately 12 percent of those who were retained received 
a needs improvement or ineffective rating. Conversely, a higher proportion (81%) of exiting teachers 
had needs improvement or ineffective ratings. 

e Similarly, the majority of teachers with an SP rating who remained in HISD had an SP rating of Level 3 
or Level 4 (66%). Of those who remained, 34 percent received an SP rating of Level 2 or Level 1. Unlike 
the trend observed for summative ratings where the majority of exited teachers were effective, the 
majority of teachers (62%) who exited HISD left with SP ratings of Level 1 or Level 2. Only 38 percent 
of those who left had an SP rating of Level 3 or 4. 
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Using both summative ratings and SP ratings, new hires were generally rated lower at higher rates than 
non-new hires. A third of new hires were rated needs improvement or ineffective in their summative 
rating, compared to 10 percent of non-new hires. For SP, over half of new hires (57%) received a Level 
1 or Level 2 SP rating, compared to 33 percent of non-new hires. 

New teachers, when located at an IR school, were almost twice as likely to be rated needs improvement 
or ineffective than new teachers at schools that Met Standard (54% compared to 31%). New teachers 
at IR schools received an average rating of 2.43, compared to new teachers at Met Standard schools, 
who received an average rating of 2.71. 


Recommendations 


While new teachers are developing their instructional skills, it makes sense that they may not be 
effective on all IP criteria and in turn receive a low rating. However, new teachers and teachers with 
one to five years of experience also have the highest exit rates from the district. When almost one out 
of every five new teachers left the district from 2014-2015 to 2015-2016, many budding new teachers 
never fully developed their skills and left before they got the chance. HISD should continue to explore 
and implement strategies to support new teachers in developing their IP, while also exploring new 
strategies to retain them long enough to become effective. 

Student Progress is a student growth measure in which teachers and their appraisers work together to 
set appropriate goals for students. The process of setting individual student goals and documenting 
their outcomes is essential to effective teaching. Ensuring the accuracy of this measure is an ongoing 
effort and should remain a focus of TADS leadership. 

HISD needs to attract effective teachers to IR schools, which have a slightly lower retention rate than 
Met Standard schools. In addition, HISD needs to focus on growing and supporting teachers located at 
IR schools who typically receive lower ratings than teachers at Met Standard schools. Future research 
will further explore the possible reasons why teachers at IR schools received lower ratings and allow 
HISD leadership to address the issue accordingly. 


Administrative Response 


The results of the report in review of the 2014-2015 school year provides the Human Capital 
Department with valuable information that will inform human capital processes, trainings, and initiatives. 
Of particular interest to the Office of Human Capital are the data points around new teacher 
effectiveness, where new teachers were three times more likely to be rated as needs improvement or 
ineffective in their summative compared to their more experienced colleagues; and new teachers were 
generally rated lower at higher levels than non-new hires in summative and SP ratings. Additionally, 
new teachers hired at IR schools were identified twice as likely to be rated needs improvement or 
ineffective than new teachers at schools that Met Standard (51% compared to 31%). 

The Human Capital Department along with the Academic and Schools Office departments are currently 
working together to discuss, develop, and implement better strategies to address teacher equity 
concerns across HISD campuses, particularly noting differences in IR vs. Met Standards campuses. 
The data provided in this report along with additional data around early hiring, new teacher retention 
rates, and professional development participation rates amongst new teachers will allow us to further 
explore inequity gaps and opportunities to better address the supports that new teachers need to 
improve year over year. 

School Offices are making efforts to recruit and attract effective teachers for our most needy schools 
through various recruitment efforts (i.e. job fairs, recruiting directly from universities and colleges, 
training for principals on how to retain and recruit talent, etc.). 

School Offices are working closely with HISD’s Career Pathways pilot program. The program allows 
principals (schools) to recognize, reward, and retain their best teachers. In turn, it allows high- 
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performing teachers to specialize in an area of interest, build leadership skills, and take on additional 
responsibility without having to leave the classroom. Through job-embedded training and peer 
coaching, teacher leaders provide a contextual level of support to other teachers on their campus. 
Principals are using Career Pathway Leaders and Teacher Development Specialists to align and 
calibrate to ensure consistency across TADS Instructional Practice and Professional Expectation 
criteria. 

Career Pathway Leaders are providing instructional support and mentoring to new and/or struggling 
teachers by working with them directly to increase content knowledge, improve best practices, and 
calibrate instructional practices through the use of the TADS system. Teacher leaders work in roles 
that support teaching, learning, high levels of rigor, and engagement. They serve as coaches, 
demonstrate best practices, hold team meetings, model lessons, provide rigorous interventions, direct 
instruction, collect and analyze data, conduct observations and provide instructional feedback to 
teachers, and have a vital role in ensuring our Rice Strategic Plan, Literacy by 3 initiative, and School 
Improvement Plans (SIP) are implemented with fidelity across all content areas. 

The Career Pathways program offers opportunities for the highest performing teachers to take on 
additional opportunities, develop new skill sets, and extend their sphere of influence while remaining in 
the classroom. This teacher leadership model also helps principals build a bench of strong instructional 
leaders to serve as an additional layer of support for their peers, specifically beginning teachers. 
Performance and Continuous Improvement Managers (PCIMs) work closely with principals to support 
their efforts in growing and developing teachers through the TADS tool (i.e. calibrating with appraisers 
to ensure observation practices are aligned, one-on-one coaching to develop action steps that grow 
and develop teachers, and working with principals and appraisers to support coaching conversations). 
This report has guided the PCIM Team to re-shape its thinking in two major areas: training and support 
for campuses in the 2016-2017 school year. Constructive and relevant conversations using this data 
have taken place as a result of this report. From these conversations, priority target areas identified 
are: 1) quality in which appraisers grow, develop and rate teachers; and, 2) appraiser support and 
development of new teachers. The PCIM team will continue to utilize this information to facilitate its 
work with school leaders and appraisers. 
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Introduction 


Early in the Effective Teachers Initiative, HISD prioritized the design and implementation of a Teacher 
Appraisal and Development System (TADS) that gives teachers, principals, and district officials the 
information they need to improve instructional practice and make staffing decisions that ensure that every 
student in the district is learning from an effective teacher (Martinez & Stevens, 2015). Each teacher is 
paired with an appraiser who coaches him/her toward effective teaching practices through teaching 
observations, walkthroughs, curriculum planning, professional development, and assigning student 
outcome measures to adjudicate overall effective teaching. 


Effective teaching is determined by three appraisal components — Instructional Practice (IP), Professional 
Expectations (PE), and Student Performance (SP). See Appendix A (page 44) for the complete list of IP 
and PE criteria. Teachers are rated on a scale of one to four along each of these criteria starting with one 
as ineffective, two as needs improvement, three as effective, and four as highly effective. As shown in 
Figure 1, these ratings are then calculated over a specific algorithm to determine an overall summative 
rating on the same four-point scale (see Appendix B, page 45, for a more detailed ratings calculation 
explanation). 


Figure 1. 2014-2015 TADS Summative Rating Components 
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Source: TADS Tool 

Note: Teachers must have at least two measures of student growth to have SP count in 
their summative rating. Teachers without SP have their summative rating calculated based 
on 70 percent IP and 30 percent PE. 


Student Performance, or SP, is a composite measure that may include multiple measures of student growth, 
including value-added (EVAAS), comparative growth (lowa test or TELPAS), or student progress on 
districtwide, appraiser-approved, pre-approved assessments, student progress on appraiser-approved 
performance tasks, and student attainment on districtwide summative assessments. Teachers must have 
at least two SP measures to have an SP rating used in their summative rating. The performance level of 
each metric is determined by student scores, then weights are applied to calculate the SP rating. (See 
Appendix B, page 45, for SP Rating calculations). 
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If a teacher does not have any SP measures or just has one, the summative rating is calculated using 70 
percent IP and 30 percent PE ratings. Teachers may not have had two SP measures if they did not teach 
a course that received an EVAAS rating or Comparative Growth rating and did not complete a Student 
Progress worksheet for that course. See Appendix C (page 46) for further explanation of which courses 
received which rating. Per a 2014-2015 HISD Board of Trustees recommendation, EVAAS ratings for Math 
were not used for appraisal purposes for 2014-2015 because the state mathematics exam was revised to 
reflect new mathematics standards. This recommendation aligned with the state’s decision to not include 
the 2014-2015 math results in promotion standards or accountability calculations. 


High school teachers had two available sources for SP measures in 2014-2015: student progress 
worksheets and value-added levels (EVAAS ratings from five STAAR end-of-course assessments: English 
I, English Il, Algebra |, Biology, and U.S. History). High school teachers who did not teach courses with one 
of the STAAR assessments could still receive an SP rating if they completed two student progress 
worksheets. 


The goal of this report is to describe the distribution of teacher summative ratings and the components of 
each criteria that were used to construct a teacher's overall appraisal rating. This report then examines how 
these ratings were distributed across key campus and teacher level variables. These variables included the 
school’s academic level, Index 1 scores, state accountability ratings for schools, teachers’ years of 
experience, and whether or not a rated teacher was a core subject or critical shortage instructor. In addition, 
teacher retention and teacher movement between schools are explored as related to appraisal ratings, 
school location, and teacher experience level. Finally, teacher performance, by experience and new hire 
subgroups, is more closely examined at Improvement Required (IR) schools and Met Standard schools. 


Methods 


Data Collection and Analysis 

e Teacher appraisal data were collected from 2011-2012 to 2014-2015. A teacher is eligible for appraisal 
if s/ne was present for the beginning of the school year until the end of April of each academic year. 

e Teachers may not have been rated due to late hiring, job title changes, incorrect job titles in PeopleSoft, 
or split roles that required teachers to teach students less than 50 percent of the instructional day. 
Some of the teachers in leadership roles were appraised in ePerformance in the School Leader 
Appraisal Tool rather than TADS, however because those data were not available for 2014—2015, those 
teachers were marked as “Not Rated.” 

e Teachers were identified using the HISD Human Resources (HR) PeopleSoft definition of teachers 
which includes 1) job function of TCH, TEL, TPK, or TSC and 2) salary plan of RT, VT, RO1 or ROS. 
Teacher demographic variables were also pulled from human resources records. Teacher years of 
experience was determined using total experience. 

e Core subject teachers were identified from the ASPIRE team in HISD Research and Accountability. 
Core teachers included those that taught courses in math, science, social studies, English, and reading 
found in the ASPIRE student-linkage database. 

e Critical shortage teacher identifiers were also obtained from the ASPIRE team. These teachers were 
identified as receiving a stipend for critical shortage subject areas. The codes used were RI1, RI2 
(recruitment incentives), and CSS (strategic staffing incentive). Critical shortage areas vary from year 
to year and usually include bilingual, career and technical education, computer science, English as a 
second language, mathematics, science, and special education courses according to the Texas 
Education Agency (TEA). 
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e Appraisal ratings were pulled from the TADS Feedback and Development (F&D) Tool used by teachers, 
appraisers, principals, and district officials to track appraisal activity. Ratings for instructional practice, 
professional expectations, student performance, and overall summative ratings came from this tool. 
These ratings include: one — ineffective, two — needs improvement, three — effective, and four — highly 
effective. 

e EVAAS data and Comparative Growth (CG) data were obtained from the HISD Research and 
Accountability Department ASPIRE team and were loaded into the TADS F&D Tool for appraisal 
purposes. EVAAS ratings range from one to five, where one is significant evidence that students did 
not meet the growth standard and five is significant evidence that students exceeded the growth 
standard. CG ratings range from one to four. Student progress data, also on a scale of one to four, 
were collected in the TADS Student Performance (SP) Tool and loaded into the F&D Tool for appraisal 
purposes. See Appendix C (page 46) for an explanation of SP, EVAAS, CG, and Student Progress. 

e Accountability ratings were obtained from the TEA accountability data download for 2014-2015, 2013- 
2014, and 2012-2013. Accountability data were not available for 2011-2012. See Appendix D (page 
48) for a description of the 2015 state accountability system for school ratings. 

e Total retention was defined as those teachers from the 2014-2015 school year who remained actively 
employed in HISD in 2015-2016, whether or not they remained in the classroom. HR roster files were 
compared from May 2015 (the 2014-2015 school year) and October 2015 (the 2015-2016 school 
year). Teachers who appeared actively employed in both files were considered retained, while teachers 
who did not appear actively employed in October 2015 were considered exited teachers. 

e For this report, teacher movement is defined as teachers who stayed in the district (those retained) who 
changed location from May 2015 to October 2015, regardless of whether the location change was to a 
different school or another HISD location, and regardless of whether or not the location change included 
a promotion. Transfers occur throughout the course of the year, so this number could be constantly 
changing. 

e New hires were defined as teachers in 2014-2015 who were new hires, rehires, or promotional 
transfers. Promotions were non-teacher HISD employees promoted to teachers; i.e., employees who 
were an Associate Teacher, Hourly Teacher, Teaching Assistant or Tutor, among other types of jobs. 
Ninety percent of promotions to Teacher were Associate Teachers or Hourly Teachers. Rehires were 
either former HISD teachers or former non-teachers. 


Data Limitations 

Where indicated, the reader will find footnotes explaining data limitations. Data limitations include smaller 
n-counts of teachers appraised along campus and teacher characteristics. For example, some teachers 
were dropped by category if they taught at a school that did not receive accountability ratings or if data were 
missing in the HR roster file. 
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Results 


What was the distribution of Summative Ratings for teachers districtwide in 2014-2015? 


Using the HR definition of teachers in 2014—2015, there were a total of 11,562 teachers in May 2015. 
Of these teachers, 10,847 (94%) received a summative rating. The percentage of teachers not rated 
(6%) in 2014-2015 slightly decreased compared to 2013-2014, in which the percentage of teachers 
not rated was seven percent. 


Shown in Table 1 below and Figure 2 in the rightmost bar for 2014-2015, about one percent of 
teachers were rated ineffective, 14 percent were rated needs improvement, 65 percent effective, and 
20 percent highly effective. The average rating for 2014—2015 was 3.05. 


Table 1. Summative Rating Distribution 2014-2015 


2013-2014 2014-2015 
Rating N % N % 
Ineffective 326 3 91 <1 
Needs Improvement 1,799 17 | 1,500 14 
Effective 6,334 59 | 7,067 65 
Highly Effective 2,319 22 | 2,189 20 
Total 10,778 * | 10,847 E 


Source: TADS F&D Tool 
*Percentages may not total 100 due to rounding. 


The proportion of teachers receiving an ineffective rating fell from three percent in 2013-2014 to less 
than one percent in 2014—2015. The proportion of teachers rated needs improvement also fell from 17 
percent in 2013-2014 to 14 percent in 2014-2015. 


In all, teachers rated as needs improvement or ineffective fell five percentage points from 20 percent in 
2013-2014 to approximately 15 percent in 2014-2015. In all, 534 fewer teachers received a needs 
improvement or ineffective rating in 2014-2015 than in 2013-2014. 


Figure 2. TADS summative rating distribution 2011-2012 through 2014-2015, including PDAS 
ratings 2010-2011 


Summative Ratings 
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Source: TADS F&D Tool 
Note: Percentages may not add to 100 due to rounding. N counts include teachers without matching identifying data 
in HR files. 
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e In 2014—2015, there was a six percentage-point increase in effective-rated teachers as compared to 
2013-2014 data, from 59 percent to 65 percent, while highly-effective rated teachers fell slightly from 
22 percent in 2013-2014 to 20 percent in 2014-2015. While minor fluctuations from year to year are 
expected, it is worth noting that the 2014—2015 proportion of effective-rated teachers was the highest 
proportion since TADS was introduced in 2011-2012. 


e The Professional Development and Appraisal System (PDAS) ratings are represented in the leftmost 
bar in Figure 2 (page 7). Using PDAS, which consisted of three rating levels rather than four like TADS, 
97 percent of HISD’s teachers were rated as “Exceeds Expectations” or “Meeting Expectations” and 3 
percent were rated as falling “Below Expectations.” 


e Table 2 below shows the summative rating changes for teachers who received a summative rating in 
both 2013-2014 and 2014-2015. Red represents the number of teachers that received an ineffective 
rating both years or remained at or fell to an ineffective rating or needs improvement rating from a 
higher rating the prior year. Yellow shows the number of teachers who remained as needs improvement 
in both years or who fell from highly effective to effective in 2014-2015. Green shows the number of 
teachers who increased their ratings over the prior year, or who remained effective or highly effective. 


Table 2. Summative Ratings Changes From 2013-2014 to 2014-2015 for Teachers Who 


Received a Summative Rating in Both Years 
2014-2015 Summative Ratings 


2013-2014 : Total Rated 
; : Needs : Highly Not ‘ 
Summative Ineffective Effective : in Both 
: Improvement Effective | Rated 
Ratings Years 
Ineffective 127 
Needs Improvement 1,285 
Effective 5,220 
Highly Effective 1,994 
Not Rated 1,600 
Total 57 1,059 6,295 2,132 683 10,226 


Source: TADS F&D Tool 


e Figure 3 (page 8) and Table 3 (page 52) show summative ratings by school level. Every school level 
saw a decrease in teachers rated ineffective or needs improvement in 2014-2015 compared to ratings 
from 2013-2014. Middle schools recorded a six percentage-point drop, from 25 percent in 2013-2014 
to 19 percent in 2014-2015. Elementary schools saw a five percentage-point drop in the same time 
period, from 21 percent to 16 percent. 
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Figure 3. Summative rating distribution by school level, 2013-2014 through 2014-2015 


Summative Rating 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


Similarly, all school levels reported an increase in the percentage of teachers rated effective or highly 
effective in 2014-2015 compared to the previous year. In 2014-2015, high schools and combined 
schools (K—-8 or grades 6-12) had the highest proportion of effective or highly effective teachers, each 
with 90 percent. Elementary school and middle schools had, respectively, 84 percent and 81 percent 
of teachers rated effective and highly effective the same year. 


Figure 4 (page 10) and Table 3 (page 52) illustrate summative ratings distribution at Improvement 
Required (IR) schools and Met Standard schools, as defined by the state school accountability system. 
In line with districtwide trends of decreasing proportions of ineffective-rated teachers, both IR schools 
and Met Standard schools reported a decrease in the percentage of teachers rated ineffective. IR 
schools experienced the largest decline in percentage, from six percent in 2013-2014 to two percent 
in 2014-2015. 
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Figure 4. Summative rating distribution by school accountability rating, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e The proportion of teachers rated needs improvement decreased in 2014—2015 for both IR schools and 
Met Standard schools, however IR schools saw a very small decrease in percentage, from 28 percent 
in 2013-2014 to 27 percent in 2014-2015, while Met Standard schools saw a larger decrease, from 15 
percent to 11 percent. 


e Despite an overall decrease in the proportion of teachers rated needs improvement and ineffective, IR 
schools had more than double the proportion of these teachers compared to Met Standard schools 
(29% at IR schools compared to 12% at Met Standard schools in 2014-2015). 


e While the percentage of effective-rated teachers in 2014-2015 was the same between the two groups 
(65%), a large difference between the proportions of highly effective teachers existed (6% at IR schools 
and 23% at Met Standard schools). This 17 percentage-point gap between the two groups increased 
slightly when compared to 2013-2014, when the difference was 15 percentage points. 


e Figure 5 (page 11) shows summative ratings by school Index 1 scores. Index 1 scores are an indication 
of student achievement at a school level, based on student performance on the STAAR test. See 
Appendix D (page 48) for more detail. Index 1 scores have been categorized into four groups by score 
values. In 2014-2015, there were no schools in HISD that received an Index 1 score of 25 or below, 
therefore a comparison cannot be made at the lowest level. 


e For schools with an Index 1 score of 26 to 50, there was a 14 percentage-point increase in the 
proportion of teachers rated effective and highly effective, from 55 percent in 2013-2014 to 69 percent 
in 2014-2015. There was a corresponding 14 percentage-point decrease in teachers rated needs 
improvement or ineffective among these schools. 


HISD Research and Accountability 10 


e Schools in each score category followed a similar pattern, reporting an increase in effective and highly 
effective teachers and a decrease in needs improvement and ineffective teachers between the two 
comparison years, as can be seen in Figure 5. 


Figure 5. Summative rating distribution by school Index 1 score category, 2013-2014 and 2014- 
2015 


Summative Rating 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e Table 3 (page 52) shows summative ratings by teacher subgroups of core subject teachers, critical 
shortage teacher status, and years of experience for years 2011-2012 to 2014-2015. In general, 
teacher subgroups followed historical trends; most were rated highly effective or effective and smaller 
proportions were rated needs improvement and ineffective. 


e Figure 6 (page 12) shows summative ratings by core subject teachers and non-core subject teachers. 
In 2014-2015, a slightly smaller proportion of core teachers were rated effective or highly-effective 
compared to non-core teachers (85% compared to 89%). Accordingly, a larger proportion of core 
teachers were rated needs improvement or ineffective compared to non-core teachers (16% compared 
to 12%). 


e The proportion of core teachers that were rated effective and highly effective increased eight 
percentage points, from 77 percent in 2013-2014 to 85 percent in 2014-2015. Similarly, core teachers 
had a smaller proportion of needs improvement and ineffective teachers compared to the prior year, 16 
percent in 2014-2015 compared to 23 percent in 2013-2014. These changes were not seen in the 
percentage of effective and highly-effective non-core teachers subgroups, which only varied by two 
percentage points over those same years (87% in 2013-2014 compared to 89% in 2014-2015). 
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Figure 6. Summative rating distribution by core teachers, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e Asdiscussed previously, summative ratings for teachers overall in 2014-2015 saw an increase in highly 
effective and effective teachers and a decrease in needs improvement and ineffective teachers. It 
seems much of the change in proportions over the prior year occurred within the core teacher subgroup, 
as the non-core teacher subgroup remained relatively stable compared to the prior year, as seen in 
Figure 6 above. 


e Figure 7 shows the critical shortage teacher subgroup compared to non-critical shortage teachers. 
Critical shortage teachers and non-critical shortage teachers had similar proportions of summative 
rating levels. In 2014-2015, 86 percent of critical shortage teachers were rated highly effective or 
effective compared to 85 percent of non-critical shortage teachers. 


e Both subgroups decreased in the proportion of teachers rated needs improvement and ineffective 
compared to 2013-2014. In 2014-2015, 14 percent of critical shortage teachers were rated needs 
improvement or ineffective, compared to 19 percent in 2013-2014. Non-critical shortage teachers had 
a similar decrease in needs improvement and ineffective teachers, with 15 percent in 2014-2015 
compared to 20 percent in 2013-2014, as Figure 7 indicates. 


Figure 7. Summative rating distribution by critical shortage teachers, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 
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e Figure 8 illustrates summative ratings by teacher years of experience. In 2014-2015, the majority of 
teachers within each category were rated as effective or highly effective, from a low of 62 percent of 
new teachers to a high of 91 percent of teachers with over 20 years of experience. 


Figure 8. Summative rating distribution by years of experience, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
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e Even though the majority of new teachers were rated effective or highly effective in 2014-2015, new 
teachers overall were more than three times more likely to be rated needs improvement or ineffective 
compared to their more experienced colleagues (38% compared to 12% for all other teachers’). This 
relationship has held true for the last three schools years as well (see Table 3, page 52). 


What was the distribution of Instructional Practice (IP) Ratings in 2014-2015 compared to 
previous years and according to subgroups? 


e Figure 9 (page 14) shows IP ratings distribution from 2011-2012 through 2014-2015. These ratings 
have remained relatively stable, with the majority of teachers receiving an IP rating of effective or highly 
effective from year to year. In 2014-2015, 86 percent of teachers were rated effective or highly effective, 
while in 2013-2014, 85 percent of teachers were rated effective or highly effective. 


e From 2013-2014 to 2014-2015, there was an increase of two percentage points in the proportion of 
teachers rated highly effective, from 20 percent to 22 percent. This proportion has increased steadily 
since 2011-2012 and 2012-2013, when it was 17 percent. 


1 Calculated as the percentage of teachers who were not new who received an ineffective or needs improvement 
rating (1,116 out of 9,543). 
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Figure 9. Instructional Practice (IP) ratings 2011-2012 through 2014-2015 
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Source: TADS F&D Tool 
Note: Percentages may not add to 100 due to rounding. Sixty teachers without HR identifying 
information included in total distribution. 


Figure 10 (page 15) and Table 4 (page 53) summarize each IP rating along campus and teacher-level 
variables of interest for the current year as well as prior years. 


e Combined schools (grades K-8 or grades 6-12) had the highest proportion of highly effective teachers 
in IP for both 2013-2014 (39%) and 2014-2015 (35%) compared to other school levels. When added 
to the proportion of teachers at combined campuses who were rated effective in 2014-2015, 91 percent 
of teachers at combined campuses were rated effective or highly effective. 


e Athigh schools, 90 percent of teachers were rated highly effective or effective, compared to 84 percent 
of middle school teachers and 84 percent of elementary school teachers with the same IP ratings. 


e Middle school teachers had the highest proportion of needs improvement and ineffective IP ratings in 
2014-2015, at 16 percent. Fifteen percent of elementary school teachers were rated needs 
improvement or ineffective, 10 percent of high school teachers and eight percent of teachers at 
combined schools. 
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Figure 10. Instructional Practice (IP) ratings by school level between 2013-2014 and 2014-2015 
IP Rating 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e In addition to having the highest percentage of needs improvement and ineffective IP ratings, middle 
school teachers had the lowest percentage of teachers rated highly effective in 2014-2015, with 18 
percent compared to 21 percent of elementary school teachers, 23 percent of high school teachers and 
35 percent of combined school teachers. 


e Figure 11 (page 16) shows IP ratings by school accountability rating. In 2014-2015, teachers at 
schools that met state accountability standard had higher percentages of highly effective ratings 
compared to teachers at IR schools (25% compared to 8%). Eighty-nine percent of teachers at Met 
Standard schools were rated effective or highly effective, compared to 75 percent of teachers at IR 
schools in the same year. 


e Teachers at IR schools were more than two times more likely than teachers at Met Standard schools 


to receive an IP rating of needs improvement or ineffective, 25 percent compared to 12 percent in 
2014-2015. 
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Figure 11. Instructional Practice (IP) rating by state accountability rating, 2013-2014 and 2014- 
2015 


IP Rating 


mineffective mNeedslmprovement mEffective m Highly Effective 
100% 


90% 
80% 
70% 
60% 
50% 
40% 
30% 
20% 
10% 


Percent 


0% 4% 3% 2% 1% 
2013-2014 2014-2015 2013-2014 2014-2015 
(N=1,700) (N=1,932) (N=9,063) (N=8,807) 
Improvement Required Met Standard 


Accountability Rating 


Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


The proportion of 2014-2015 needs improvement and ineffective IP ratings decreased for both 
subgroups of teachers from the prior year. In 2013-2014, 29 percent of teachers at IR schools were 
rated needs improvement or ineffective but in 2014-2015 that percentage had decreased to 25 percent. 
For teachers at Met Standard schools, the percentage decreased from 14 percent to 12 percent. 


Figure 12 (page 17) illustrates teachers’ IP ratings across categories of schools’ Index 1 scores. There 
were no teachers at a school that received an Index 1 score of less than 25, so no data existed for that 
group in 2014—2015. 


Schools with an Index 1 score between 26 and 50 saw an increase in the percentage of teachers rated 
highly effective and effective for their IP, from four percent to six percent and from 59 percent to 67 
percent respectively over the comparison years. At the same time, there was also a decrease in the 
percentage of teachers rated needs improvement (32% to 23%) and ineffective (6% to 4%) at those 
schools. 


In general, other subgroups of teachers at all levels of school Index 1 scores reported similar trends 
over the previous year, with increasing percentages of highly effective and effective IP ratings and 
decreasing percentages of needs improvement and ineffective IP ratings. 


One exception was for teachers at schools with an index score greater than 75. The percentage of 
teachers with an effective IP rating decreased, while the percentage of highly effective IP ratings 
increased between the two years, from 30 percent in 2013-2014 to 38 percent in 2014-2015. 
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Figure 12. Instructional Practice (IP) rating distribution by Index 1 score, 2013-2014 and 2014- 
2015 
IP Rating 
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e Figure 13 (page 18) shows IP ratings by years of experience subgroups. New teachers were less likely 
to be rated as effective or highly effective for the past two years compared to their more experienced 
colleagues. In 2014-2015, new teachers saw an increase in needs improvement IP ratings, from 30 
percent in the prior year to 33 percent while ineffective IP ratings for new teachers remained stable at 
five percent. This increase in needs improvement ratings was coupled with a decrease in highly 
effective ratings (6% to 3% for new teachers). 


e Teachers who were not new to the classroom had relatively unchanging percentages in their 2014— 


2015 IP ratings relative to 2013-2014. The majority of teachers at all levels of experience received an 
effective IP rating, which occurred in 2013-2014 as well. 
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Figure 13. Instructional Practice (IP) rating by years of experience, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e Table 5 below shows IP changes by teacher counts between 2013-2014 and 2014-2015. Red 
represents the number of teachers that received an ineffective rating both years or remained at or fell 
to an ineffective rating or needs improvement rating from a higher rating the prior year. Yellow shows 
the number of teachers who remained as needs improvement in both years or who fell from highly 
effective to effective in 2014-2015. Green shows the number of teachers who increased their ratings 
over the prior year, or who remained effective or highly effective. 


Table 5. Instructional Practice (IP) Changes from 2013-2014 to 2014-2015 for 
Teachers with Ratings in Both Years 
2014-2015 IP Ratings 


2013-2014 IP Total Rated 
Ratings Needs Highly in Both 
Ineffective | Improvement | Effective | Effective Years 
Ineffective 41 
Needs Improvement 995 
Effective | 5,580 
Highly Effective 1,751 
Total 2,139 8,367 


Source: TADS F&D Tool 
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What was the distribution of Professional Expectations (PE) Ratings in 2014-2015 compared to 
previous years? 


e Figure 14 shows PE ratings distribution from 2011-2012 through 2014-2015. For 2014-2015, the 
majority of teachers were rated Level 3 (70%) followed by Level 4 (27%), and Level 2 (2%). No teachers 
were rated at Level 1 for PE in any of the years reported. 


e Level 2 ratings have not varied much from year to year. However, the percentage of teachers rated at 
Level 4 for PE has steadily increased from a low of 19 percent in 2011-2012 and 2012-2013 to a high 
of 27 percent in 2014-2015. 


Figure 14. Professional Expectation (PE) ratings 2011-2012 through 2013-2014 
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Source: TADS F&D Tool 
Note: Percentages may not add to 100 due to rounding. N counts include teachers without HR 
identifying information. 


What was the distribution of Student Performance (SP) Ratings in 2014-2015 compared to 
previous years? 


e Figure 15 (page 20) shows that the percentage of teachers who received an SP rating for the past 


three years has been steadily increasing. In 2014-2015, 43 percent of rated teachers received an SP 
rating along with an IP and PE rating to make up their overall summative rating. 


HISD Research and Accountability 19 


Figure 15. Teachers with Student Performance rating 2012-2013 through 2014-2015 
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e Figure 16 shows the distribution of SP ratings from 2012-2013 to 2014-2015. The percentage of Level 
4 SP ratings has increased each year, and in 2014-2015 was 35 percent of all SP ratings. Teachers 
with a Level 3 SP rating were the next highest group in 2014-2015, at 28 percent, followed by Level 2 
at 25 percent and Level 1 at 12 percent. 


e There was a decrease in the 2014-2015 percentage of Level 3 and Level 4 ratings compared to the 
prior year (from 69% in 2013-2014 to 63% in 2014—2015), and an increase in Level 1 and Level 2 
ratings from the prior year (31% in 2013-2014 to 37% in 2014-2015). 


Figure 16. Student Performance ratings 2012-2013 through 2014—2015 
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Table 6 below shows that average scores teachers received in 2014-2015 by SP measure. Student 
Progress/Attainment (combining student progress on summative assessments, performance tasks, and 
student attainment on summative assessments) had the highest average score of 3.43 in 2014-2015. 
Value-added had the second-highest score of 2.97, and Comparative Growth had the lowest average 
score of 2.63. 


Table 6. Average scores for Each SP Component: Student Progress, Value-Added, and 


Comparative Growth, 2014-2015 


SP Component 


Number of Teachers* 


Average Score 


Student Progress/Attainment 1,948 3.43 
Value-Added (EVAAS) 2,675 2.97** 
Comparative Growth 3,208 2.63 


“Indicates number of teachers scored within the component. Teachers needed at least two measures within 
these components to receive an SP rating. Some teachers may have only had an EVAAS score, for example, 
and would not have received an SP rating. Total teachers with SP rating = 4,638. 

*“Unadjusted average. Value-added scores were on a scale of one to five. Other SP components were on a 
scale of one to four. An adjustment was made in teachers’ SP ratings with value-added scores to account for 
the different scale. See Appendix B, page 45, for more information. 

Source: TADS F&D Tool 


e Out of those teachers with an SP rating in 2014-2015 (4,638), 69 percent (3,213) had at least one 
Comparative Growth measure (lowa or TELPAS data). Twelve percent (565) had only Comparative 
Growth measures calculated into their SP rating. 


e The 2014-2015 average summative rating for teachers with at least one Comparative Growth measure 
included in their SP rating was 2.96, while the average summative rating for teachers with Comparative 
Growth as their only measure of student performance was 3.00. 


e Out of those teachers with an SP rating in 2014-2015 (4,638), 37 percent (1,732) had at least one 
Student Progress measure. In 2013-2014, 502 teachers (12 percent of teachers in 2013-2014 with 
SP) had at least one Student Progress measure. 


e For 2014-2015, 26 percent (1,185) of teachers with an SP rating used only Student Progress measures 
in their SP rating calculation. 


e The average summative rating for teachers with at least one Student Progress measure included was 
3.26, while the average summative rating for teachers with Student Progress as their only measure of 
student performance was 3.33. 


e For value-added, in 2014-2015 there were 3,580 teachers (33% of rated teachers) with at least one 
EVAAS rating on file (not including math ratings). 


e Out of those 2014-2015 teachers with an SP rating (4,638), 58 percent (2,675) had at least one Value- 
added (EVAAS) measure used in their rating. Value-added measures cannot be the sole measure used 


in SP ratings, so no teachers had only Value-added used for their calculations. 


e Figure 17 (page 22) shows the distribution of EVAAS ratings from 2012-2013 to 2014-2015 for all 
teachers with at least one EVAAS rating, whether or not the rating was used in their SP rating. In 2014— 
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2015 teachers with a Level 3 EVAAS rating, or not significantly different from average student growth, 
made up 28 percent of EVAAS-rated teachers. 


e The proportion of Level 5 ratings increased slightly in 2014-2015 compared to previous years and was 
23 percent. Level 1 ratings also increased from 19 percent in 2013-2014 to 25 percent in 2014-2015. 
In 2014-2015, 39 percent of teaches with EVAAS fell below the middle Level 3 rating, and 32 percent 
of teachers were above the middle rating with a Level 4 or 5. 


Figure 17. Composite EVAAS rating distribution 2012-2013 through 2014-2015 
EVAAS Performance Level 
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What was the distribution of Student Performance (SP) Ratings in 2014-2015 compared to 2013- 
2014 according to subgroups? 


e Figure 18 (page 23) and Table 7 (page 54) show SP ratings by school level from 2013-2014 and 
2014-2015. Every school level except middle school saw an increase in Level 4 SP ratings. The most 
dramatic increase was among high school teachers, who jumped from 27 percent at Level 4 in 2013— 
2014 to 67 percent in 2014-2015. There was also a sharp increase in the number of high school 
teachers receiving an SP rating, from 26 in 2013-2014 to 473 in 2014-2015. 
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Figure 18. SP rating distribution by school level, 2013-2014 and 2014-2015 
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e Though high school teachers could receive an SP rating through either EVAAS or Student Progress, 
Student Progress was the sole source of student growth data for 71 percent of high school teachers 
with an SP rating (335 out of 473). As Table 6 (page 21) indicates, student progress ratings were higher 
on average than the other two components of SP, and could therefore explain the high percentage of 
high school teachers with a Level 4 SP rating. 


e Outside high school teachers, all other subgroups of teachers at different school levels had an increase 
in Level 2 SP ratings and a decrease in Level 3 ratings. 


e 2014-2015 elementary school teachers saw an increase in Level 4 SP ratings over the prior year, from 
30 percent in 2013-2014 to 32 percent in 2014-2015. 
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e Figure 19 illustrates SP rating distribution by school accountability ratings for 2013-2014 and 2014— 
2015. Out of 2,143 teachers at IR schools, 652 (30%) received an SP rating in 2014-2015. Out of 9,358 
teachers at Met Standard schools, 3,980 (43%) received an SP rating in 2014-2015. 


Figure 19. SP rating distribution by accountability rating, 2013-2014 and 2014-2015 
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Source: TADS F&D Tool, HR Roster File 
Note: Percentages may not add to 100 due to rounding. 


e Similar to the prior year, 2014-2015 teachers at IR schools had lower percentages of Level 4 and Level 
3 SP ratings compared to teachers at Met Standard schools. In 2014-2015, 13 percent of teachers with 
an SP rating at an IR school received a Level 4, compared to 39 percent of teachers at Met Standard 
schools. 


e 2014-2015 teachers at IR schools were more likely to receive a Level 2 or Level 1 SP rating (66%) 
compared to teachers at Met Standard schools (32%). 
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e Figure 20 shows SP rating distribution by school Index 1 score in 2013-2014 and 2014-2015. The 
proportion of Level 3 and 4 teachers increased with each category increase in Index 1 scores. For 
example, in 2014-2015 81 percent of teachers at the highest Index 1 score category 75 or higher were 
rated at Level 3 or 4, while 34 percent of teachers at schools in the 25 to 50 Index 1 score category 
received a Level 3 or 4 rating. 


Figure 20. SP rating distribution by school Index 1 score category, 2013-2014 and 2014-2015 
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e Table 7 (page 54) describes SP ratings by teacher level data. The majority (90%) of 2014-2015 
teachers with SP were core subject teachers. In 2013-2014, this number was 99.8 percent. More non- 
core subject teachers received an SP rating in 2014-2015 and accounted for 10 percent of teachers 
with an SP rating. 
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e Figure 21 shows SP ratings by teacher experience level for 2013-2014 and 2014-2015. New teachers 
were more frequently rated as SP Level 1 or 2 compared to their more experienced colleagues. In 
2014-2015, 59 percent of new teachers with an SP rating received a one or two, compared to 27 
percent of teachers with more than 20 years of experience. 

Figure 21. SP rating distribution by years of experience, 2013-2014 and 2014-2015 
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What was the impact of SP on summative ratings in 2014-2015? 


e Figure 22 (page 27) shows the 2014-2015 distribution of all summative ratings along each SP 
performance level, with SP Level 1 indicating teachers with students that did not meet expectations 
and SP Level 4 indicating teachers with students that exceeded expectations according to the selected 
student performance measures. Note that because SP was used to calculate teachers’ summative 
ratings, the two are not mutually exclusive. Therefore, some caution should be used when interpreting 
their alignment, as SP directly impacts the summative rating. 


e Overall, the data show that summative ratings and SP ratings were generally aligned. For example, 95 
percent of teachers rated SP Level 3 received a summative rating of effective or highly effective. In 
addition, 100 percent of teachers with an SP rating Level 4 received a summative rating of effective or 
higher. 
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Of those teachers with an SP rating Level 1, 69 percent of them received a summative rating of needs 
improvement or ineffective. However, 31 percent of them received a summative rating of effective, 
displaying a slight discrepancy between the two ratings. Similarly, of teachers with an SP rating Level 
2, 79 percent of them received a summative rating of effective or highly effective, suggesting that SP 
contributed measures that were not included in either IP or PE. 


Finally, the majority of rated teachers did not receive an SP rating (57%). Of those that did not receive 
an SP rating, 85 percent received a rating of effective or highly effective. This percentage exactly aligns 
with those teachers with an SP rating, of which 85 percent received a summative rating of effective or 
highly effective. 


Figure 22. Summative ratings by SP performance levels for all rated teachers and measures, 
2014-2015 (N=10,847) 
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Figure 23 (page 28) shows the distribution of 2014-2015 summative ratings for teachers by SP ratings 
with value-added measures compared to those without value-added measures included in the SP rating 
calculations. 


Teachers with SP Level 1 ratings with EVAAS were rated needs improvement for their summative 66 
percent of the time, while those without EVAAS were 58 percent of the time. 


At SP Level 2, there was a slight difference between the two subgroups, when 18 percent of teachers 
with EVAAS received a summative rating of needs improvement compared to 27 percent of teachers 
without EVAAS. 
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e At SP Level 2, 82 percent with EVAAS and 73 percent without EVAAS received a summative rating of 
effective or highly effective. 


e Ratings were more closely aligned at the high levels of SP, when the clear majority of teachers at these 
levels, with or without EVAAS, were rated effective or highly effective. 


Figure 23. Summative ratings by SP ratings with value-added versus without value-added 
measures, 2014-2015 (N=4,638) 
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Source: TADS F&D Tool 
Note: Percentages may not add to 100 due to rounding. SP was used to calculate teachers’ summative ratings, therefore the 
two are not mutually exclusive. 


How did SP ratings, with and without EVAAS, align with IP ratings in 2014-2015? 


e Figure 24 (page 29) shows how IP varied across SP levels between all SP ratings, SP ratings with 
value-added measures, and SP ratings without value-added measures. In general, the data show that 
IP ratings were distributed similarly among all three groups of SP ratings. The majority of IP ratings at 
each level of SP were effective, with a range of 48 percent to 67 percent. 


e For all groups of SP, the highest proportion of needs improvement and ineffective IP ratings were found 
for those teachers at the lowest levels of SP ratings (SP Level 1 and SP Level 2). However, there was 
slight misalignment at SP Level 3 and 4 when a small percentage of those teachers achieving above 
average student growth (according to their selected metrics) were rated as needs improvement or 
ineffective in their instructional practice. 
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Figure 24. IP ratings distribution by SP performance levels, 2014-2015 
IP Rating 
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How did value-added (EVAAS) ratings align with IP and Summative ratings? 


e Figure 25 (page 30) shows the relationship between IP ratings and EVAAS rating levels. Overall the 
data show that there were more teachers rated as IP highly effective with increasing EVAAS level. 
Conversely, there were fewer teachers rated as ineffective and needs improvement with increasing 
levels of EVAAS. Teachers rated as EVAAS Level 3 comprised the majority of EVAAS-rated teachers. 


e These findings suggest directional alignment between IP and EVAAS ratings. For example, adding 
together IP ratings of effective and highly effective across all levels of EVAAS, the data show an 
increase in effective teachers with increased level of EVAAS. There were 73, 83, 84, 93, and 97 percent 
of IP effective and highly effective teachers with each level increase in EVAAS, from level one to five. 
See Appendix C (page 46) for EVAAS Levels, gain indices, and further interpretation. 
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Figure 25. IP and EVAAS rating alignment, 2014-2015 (N=2,676) 
IP Rating 
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e Figure 26 (page 31) shows the relationship between summative ratings and EVAAS rating levels. 
Overall, there were 2,676 teachers with an SP rating that had an EVAAS rating calculated into their 
overall summative rating. 


e While large proportions of teachers rated effective in their summative rating existed at all levels of 
EVAAS, teachers with higher EVAAS ratings were more likely to receive an effective or highly effective 
summative rating. In fact, at the highest level of EVAAS, 100 percent of teachers received a summative 
rating of effective or highly effective. At EVAAS level 4, a small percentage of teachers (2%) received 
a summative rating of needs improvement. 


e Atthe lowest level of EVAAS, the majority of teachers (55%) received a needs improvement summative 


rating. However, at EVAAS level 2, 84 percent of teachers received an effective or highly effective 
summative rating. 
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Figure 26. Summative Rating and EVAAS rating alignment, 2014-2015 (N=2,676) 


Summative Rating 


Ineffective m Needs Improvement MEffective m Highly Effective 
100% 


90% 
80% 
70% 
60% 
50% 
40% 
30% 
20% 
10% 

0% 


Percent 


3% 1% 2% 
EVAAS Level 1 EVAAS Level 2 EVAAS Level 3 EVAAS Level 4 EVAAS Level 5 
(N=646) (N=376) (N=727) (N=255) (N=672) 

EVAAS Rating Levels 


Source: TADS F&D Tool 
Note: Percentages may not add to 100 due to rounding. 


What were retention and movement rates of 2014-2015 HISD teachers? 


e From year to year, teachers in HISD make career decisions that involve whether to stay in HISD or 
leave the district, as well as whether to stay at their current HISD school or transfer to another location. 
Figure 27 shows the rate at which teachers stayed in HISD (retention) from 2014-2015 to 2015-2016 
and if they stayed in HISD, the rate at which they stayed at their current school (movement) in the same 
years. 


Figure 27. Total teacher retention and movement rates, 2014-2015 to 2015-2016 


Teacher Retention Teacher Movement 
(N=11,562) (Active Teachers Only, N=9,892) 
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Source: HR Roster, May 2015 and October 2015 
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Figure 27 (page 31) shows that 86 percent of teachers (9,892) stayed in HISD from 2014-2015 to 
2015-2016 while 14 percent left HISD (1,670). 


Figure 27 (page 31) shows that 89 percent of teachers who remained in HISD did not change locations 
between those two years, and 11 percent did change location. 


Figure 28 shows teachers who remained in HISD and those who left HISD by summative ratings. The 
majority of 2014-2015 teachers who stayed in 2015-2016 (88%) received an effective or highly 
effective summative rating in 2014-2015. Twelve percent of those retained received a needs 
improvement summative rating, and a very low percentage of the teachers (0.3%, or 28 teachers) who 
stayed in HISD received an ineffective rating. 


Conversely, almost a third (831%) of teachers who left HISD had needs improvement or ineffective 
summative ratings. While it is true that a higher percentage of exited teachers left with ineffective or 
needs improvement ratings, nearly 70 percent of those who left had effective or highly effective ratings. 


Figure 28. Teacher retention by summative ratings, from 2014—2015 to 2015-2016 
2014-2015 Summative Ratings 
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Figure 29 (page 33) shows teachers who remained in HISD and those who left HISD by SP ratings. 
Similar to summative ratings, the majority of teachers who remained in HISD had an SP rating of Level 
3 or Level 4 (66 %). Of those who remained, 34 percent received an SP rating of Level 2 or Level 1. 


On the other hand, the majority of teachers (62%) who exited HISD left with SP ratings of Level 1 or 
Level 2. Twenty-eight percent left with a Level 1 SP rating, and 34 percent left with a Level 2 SP rating. 
Only 38 percent of those who left had an SP rating of Level 3 or 4. 
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Figure 29. Teacher retention by SP ratings, from 2014-2015 to 2015-2016 
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Source: TADS F&D Tool, HR Roster, May 2015 and October 2015 
Note: Percentages may not add to 100 due to rounding. 


e Figure 30 shows teacher retention rates by school state accountability rating. Depending on the 
accountability rating, the retention rate varied slightly. IR schools retained teachers at a rate of 83 
percent, while Met Standard schools retained 87 percent of teachers. In other words, teachers left HISD 
at a rate that was four percentage points higher at IR schools than at Met Standard schools (17% 
compared to 13%). 


Figure 30. Teacher retention by accountability ratings, from 2014-2015 to 2015-2016 
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Source: TADS F&D Tool, HR Roster, May 2015 and October 2015 
Note: Percentages may not add to 100 due to rounding. 


e Figure 31 (page 34) shows the difference in summative ratings between retained and exited teachers 
based on school accountability rating. Teachers who left the district from both IR schools and Met 
Standard schools had higher proportions of needs improvement and ineffective ratings than those who 
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stayed in the district. Both types of schools effectively retained a larger proportion of effective and highly 
effective teachers, though not at equal rates. 


e AtIR schools, 25 percent of retained teachers were rated ineffective or needs improvement, compared 
to 49 percent of exited teachers at IR schools. At Met Standard schools, nine percent of retained 
teachers were rated low compared to 25 percent of exited teachers. 


Figure 31. Teacher retention by summative ratings and accountability ratings, from 2014-2015 to 
2015-2016 
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e Figure 32 (page 35) illustrates retention rates of teachers who received a summative rating by 
subgroup of teacher experience level. As years of experience increased, so did the retention rate for 
each group, except for teachers with over 20 years of experience, who were probably exiting the district 
through retirement. 


e New teachers had the lowest rate of retention compared to all other experience groups, at 81 percent, 
and were below the district total retention rate of 86 percent. Additionally, teachers with one to five 
years of experience were retained at a rate lower than the district rate as well, indicating that less 
experienced teachers in general are exiting the district at higher rates than their more experienced 
colleagues. 
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Figure 32. Teacher retention by years of experience, from 2014—2015 to 2015-2016 
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e In addition to teacher retention, teacher movement within the district may provide valuable insight into 
the career decision-making process of HISD teachers. Figure 33 describes teacher movement by 
summative ratings. Overall, teachers who changed locations had a higher proportion of needs 
improvement and ineffective ratings than teachers who remained at their schools. However, the 
majority of teachers (79%) who changed location were rated effective or highly effective. 


e Teachers who stayed at the same location had a larger proportion of effective and highly effective 
ratings than those those who moved (89% compared to 79%). 


Figure 33. Teacher movement by summative ratings, 2014-2015 to 2015-2016 
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e Figure 34 shows teacher movement by SP ratings. Teachers who changed location from 2014-2015 
to 2015-2016 had a higher proportion of Level 1 and Level 2 ratings (51%) than teachers who did not 
change location (33%). 


e Of teachers who remained at the same school for those two years, 40 percent received a Level 4 SP 
rating, compared to 21 percent of teachers who changed location. Overall, teachers with low SP ratings 
were more likely to change HISD location than teachers with higher SP ratings, who were more likely 
to stay at their location. 


Figure 34. Teacher movement by SP ratings, from 2014-2015 to 2015-2016 
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e Figure 35 below shows teacher movement by school state accountability ratings. IR schools saw a 
higher percentage of their teachers change location than Met Standard schools. From 2014-2015 to 
2015-2016, 17 percent of teachers from IR schools changed HISD location, compared to 10 percent 
of teachers at Met Standard schools. 


Figure 35. Teacher movement by accountability ratings, from 2014-2015 to 2015-2016 
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e Figure 36 shows that, of teachers that changed location from their IR school in 2014-2015, a higher 
percentage of them received a needs improvement or ineffective rating than those that remained at the 
IR school (33% compared to 23%). Of teachers that remained at their IR school, 78 percent of them 
were rated effective or highly effective. 


e Of teachers that changed location from their Met Standard school from 2014-2015 to 2015-2016, 16 
percent were rated needs improvement or ineffective. Of teachers that remained at their Met Standard 
school, 91 percent of them were rated effective or highly effective. 


Figure 36. Teacher Movement by summative ratings and accountability ratings, from 2014-2015 to 
2015-2016 
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How did the summative ratings of new hires compare to the ratings of other teachers in 2014— 
2015? 


e After teachers leave the district, new hires fill vacant spots. New hires, regardless of their years of 
experience, enter the district to fill a teacher vacancy. The breakdown of new hires’ years of experience 
can be seen below in Table 8. 


Table 8. Distribution of New Hires and Years of 
Experience (N=2,469) 
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Experience Level in Number of New Percent 
2014-2015 Hires (%) 
New Teacher 1,284 52 
1 to 5 Years 479 19 
6 to 10 Years 358 14 
11 to 20 Years 249 10 
Over 20 99 4 
Total 2,469 i 


Source: HR Roster 


Note: Percentages may not add to 100 due to rounding. 


e While 52 percent of new hires in 2014-2015 were new teachers with zero years of experience, 
approximately half of new hires had at least one year of experience. Experience may or may not be in 
the classroom. Twenty-nine percent of new hires had six or more years of experience. See Table 8 
(page 37) for the distribution of new hires and years of experience. 


e Figure 37 shows how new hires were rated compared to non-new hires using summative ratings and 
SP ratings. Using both appraisal metrics, new hires were generally rated lower at higher rates than 
non-new hires. A third of new hires, 35 percent, were rated needs improvement or ineffective in their 
summative ratings, compared to 10 percent of non-new hires. 


e Asimilar pattern emerges using SP ratings, as over half of new hires (57%) received a Level 1 or Level 
2 SP rating, compared to 33 percent of non-new hires. 


Figure 37. Summative ratings and SP ratings by new hires 
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How did average summative ratings for teachers at IR schools differ from those of teachers at Met 
Standard schools? 


e Figure 38 (page 39) provides a closer look at the relationship between a teacher’s location at an IR 
school and the teacher’s subsequent summative rating. It shows that, for 2014-2015, the average 
summative rating of teachers located at an IR school was 2.75 and was 3.11 for teachers at Met 
Standard schools, 0.36 points lower for teachers at IR schools. 
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Figure 38. IR and Met Standard schools and teachers’ average summative ratings, 2014-2015 
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e Figure 39 shows teachers’ summative ratings at IR schools and Met Standard schools, by teachers’ 
years of experience. As previously discussed on page 12, 2014-2015 IR schools had smaller 
proportions of teachers rated highly effective and larger proportions of teachers rated as needs 
improvement and ineffective than Met Standard schools. This pattern held true across teacher 
experience subgroups; teachers at every experience level had smaller proportions of highly effective 
ratings and larger proportions of needs improvement and ineffective ratings at IR schools. 


Figure 39. Summative ratings of teachers at IR schools and Met Standard schools, by years of 
experience, 2014-2015 
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e Newteachers, when located at an IR school, were almost twice as likely to be rated needs improvement 
or ineffective than new teachers at Met Standard schools (54% compared to 31%). 


e New teachers at IR schools received an average rating of 2.43, compared to new teachers at met 
Standard schools who received an average rating of 2.71. 


e Figure 40 shows teachers’ summative ratings at IR schools and Met Standard schools, by new hires 
versus non-new hires. Teachers at IR schools, whether or not they were identified as a new hire, had 
larger proportions of needs improvement and ineffective-rated ratings compared to Met Standard 
schools. 


Figure 40. Summative ratings of new hires and non-new hires at IR schools and Met Standard 
schools, by years of experience, 2014-2015 
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e New hires, when located at an IR school, were almost twice as likely to be rated needs improvement 
or ineffective than new hires at schools that met Standard (50% compared to 28%). 


e New hires at IR schools received an average rating of 2.48, compared to new hires at met Standard 
schools who received an average rating of 2.79. 
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Discussion 


The Effective Teachers Initiative (ETI) was launched in 2010 in order to provide every student in HISD 
excellent instruction by growing and developing teachers. As part of the initiative, HISD adopted the 
Teacher Appraisal and Development System (TADS) to provide teachers, principals, and district officials 
the information they need to improve instructional practice, to inform staffing decisions, and to ensure every 
student is taught by an effective teacher. This report has examined teacher appraisal outcomes for the 
2014-2015 school year, and has gone on to explore teacher retention and movement by appraisal ratings. 
Trends observed in appraisal outcomes and teacher career movement can guide decision-makers in their 
work toward accurately rating effective teaching, growing teachers, and ultimately placing an effective 
teacher in every classroom. 


The 2014-2015 proportion of effective teachers overall was the highest since TADS was introduced in 
2011-2012, at 65 percent; combined with highly effective teachers the proportion was 85 percent. Much of 
this growth in effective and highly effective ratings was from the core subject subgroup of teachers. The 
proportion of core subject teachers rated effective or highly effective increased eight percentage points over 
the prior year, from 77 percent in 2013-2014 to 85 percent in 2014-2015, while the proportion of needs 
improvement and ineffective-rated core teachers fell from 23 percent to 16 percent in those same years. 
This shift was not observed in the non-core subject teacher subgroup, which remained relatively stable 
between the two years. 


Even though the majority of new teachers were rated effective or highly effective (62%), new teachers 
overall were more than three times more likely to be rated as needs improvement or ineffective in their 
summative rating compared to their more experienced colleagues (38% compared to 12% for other 
experience groups). While new teachers are developing their instructional skills, it makes sense that they 
may not be effective on all rating criteria and in turn receive a lower rating. However, new teachers and 
teachers with one to five years of experience also have the highest exit rates from the district. When almost 
one out of every five new teachers left the district from 2014-2015 to 2015-2016, many budding new 
teachers never fully developed their skills and left before they got the chance. 


Student Performance ratings allow for student growth to be documented and tracked within HISD’s 
appraisal system. The percentage of teachers receiving an SP rating has risen from year to year, from a 
low of 35 percent in 2012-2013 to 43 percent in 2014-2015. The percentage of Level 4 SP ratings has 
increased each year, and in 2014-2015 was 35 percent of all SP ratings. 


Student Progress measures (on summative assessments or performance tasks) make up two out of the 
five SP measures. Student Attainment is another component of SP, and in 2014-2015 was a measure only 
available to Pre-K teachers. The use of Student Progress/Attainment measures as an SP rating component 
increased more than threefold, from 502 teachers in 2013-2014 to 1,732 teachers in 2014-2015. Teachers 
with Student Progress/Attainment measures included in their overall rating had a higher average rating than 
teachers overall (3.26 compared to 3.05). Average Student Progress/Attainment ratings by themselves 
were higher than the averages of the other two SP measures as well (3.43 compared to 2.97 for EVAAS, 
and 2.63 for Comparative Growth). Student Progress (not including Student Attainment) is a student growth 
measure in which teachers and their appraisers work together to set appropriate goals for students. The 
process of setting individual student goals and documenting their outcomes is essential to effective 
teaching. Ensuring the accuracy of this measure is an ongoing effort and should remain a focus of TADS 
leadership. 
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Understanding the moving stream of teachers out of the district as well as within the district and its main 
tributaries can help HISD leadership better manage which teachers leave and which stay. The majority of 
teachers who stayed in 2015-2016 received an effective or highly effective summative rating in 2014-2015, 
while approximately 12 percent of those who were retained received a needs improvement or ineffective 
rating. Conversely, a higher proportion (31%) of exiting teachers had needs improvement or ineffective 
ratings. Still, the majority of exiting teachers were effective teachers. Similar to summative ratings, the 
majority of teachers who remained in HISD had an SP rating of Level 3 or Level 4 (66%). Of those who 
remained, 34 percent received an SP rating or Level 2 or Level 1. Unlike the trend observed for summative 
ratings where the majority of exited teachers were effective, the majority of teachers (62%) who exited HISD 
left with SP ratings of Level 1 or Level 2. Only 38 percent of those who left had an SP rating of Level 3 or 
Level 4. 


In general, teachers who changed locations had a higher proportion of needs improvement and ineffective 
ratings than teachers who remained at their schools. However, the majority of teachers (79%) who changed 
location were rated effective or highly effective. Teachers who stayed at the same location had a larger 
proportion of effective and highly effective ratings than those who moved (89% compared to 79%). 


After teachers leave the district, new hires fill vacant spots. New hires, regardless of their years of 
experience, enter the district to fill a teacher vacancy. For this report, new hires were defined as teachers 
in 2014-2015 who were new hires, rehires, or promotional transfers (48% of new hires had at least one 
year of experience). Using both summative ratings and SP ratings, new hires were generally rated lower 
than non-new hires. More than a third of new hires were rated needs improvement or ineffective in their 
summative rating, compared to 10 percent of non-new hires. For SP, over half of new hires (57%) received 
a Level 1 or Level 2 SP rating, compared to 33 percent of non-new hires. 


Transforming low-performing schools (IR schools) is a districtwide effort. However, IR schools have higher 
proportions of ineffective and needs improvement-rated teachers than Met Standard schools. New 
teachers, when located at an IR school, were almost twice as likely to be rated needs improvement or 
ineffective than new teachers at schools that Met Standard (54% compared to 31%). New teachers at IR 
schools received an average rating of 2.43, compared to new teachers at Met Standard schools who 
received an average rating of 2.71. 


Similarly, new hires, when located at an IR school, were almost twice as likely to be rated needs 
improvement or ineffective than new hires at schools that met Standard (50% compared to 28%). New hires 
at IR schools received an average rating of 2.48, compared to new hires at Met Standard schools, who 
received an average rating of 2.79. New teachers, new hires, and teachers overall may not have adequate 
support to overcome the obstacles and challenges that they face at an IR school. 


HISD needs to attract effective teachers to IR schools, which have a slightly lower retention rate than Met 
Standard schools. In addition, HISD needs to focus on growing and supporting teachers located at IR 
schools who typically receive lower ratings than teachers at Met Standard schools. Future research will 
further explore the possible reasons why teachers at IR schools received lower ratings and allow HISD 
leadership to address the issue accordingly. 
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APPENDIX A: TADS IP and PE Criteria 


HISD Teacher Appraisal and Development System 
Instructional Practice and Professional Expectations Rubrics 


Instructional Practice Criteria Professional Expectations Criteria 


my 6PL-1 Develops student learning goals PR-1 Complies with policies and procedures at pg. 15 
< PL-2 Collects, tracks, and uses student data to drive school 
= instruction PR-2 Treats colleagues with respect throughout all pg. 16 
8 Designs effective lesson plans, units, and aspects of work 
assessments PR-3 Complies with teacher attendance policies pg. 17 
[4 
e i i . 18 
Facilitates organized, student-centered, Sy PR-4 Dresses professionally according to school Pg: 
hice . E policy 
objective-driven lessons & 
c zi i ab] 
Checks for student understanding and responds 5 Mis Pallaboiates wilicellesayes o- 
to student misunderstanding 4 PR-6 Implements school rules pg. 20 
Differentiates instruction for student needs by £ PR-7 Communicates with parents throughout the pg. 21 
employing a variety of instructional strategies year 
Engages students in work that develops higher- PR-8 Seeks feedback in order to improve pg. 22 
level thinking skills performance 


Maximizes instructional time PR-9 Participates in professional development and pg. 23 


Communicates content and concepts to apples lsathing 


students 


< 
i} 
‘= 
oS 
5 
= 
= 
uv 
= 


Promotes high academic expectations for 
students 


Students actively participating in lesson 
activities 

Sets and implements discipline management 
procedures 


Builds a positive and respectful classroom Excerpt from the HISD Teacher Appraisal and Development System 
environment Instruction Practice and Professional Expectations Rubric 


HISD Instructional Practice and Professional Expectations Rubrics — Page 1 
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APPENDIX B: TADS Ratings Calculation 


I. The three TADS components! would have the following weights within teachers' Summative Appraisal Ratings. 


Instructional Practice Professional ae ectations Student Performance 


II. The various types of Student Performance measures would have different weights within the 
Student Performance Final rating. 


aisnasbes| 


' i 
VA + CG + CG+ VA + Student Progress 


VA + CG Student Progress Student Progress CG Only Student Progress Only 
Value —Added? 20% 15% 20% 
Comparative Growth 10% 10% 20% 30% 
Student Progress 5% 10% 10% 30% 


Fir: The component weights are applied using a weighted average to derive the summative appraisal rating. 
Highly Effective Effective Needs Improvement Ineffective 
Score Range: 3.50 - 4.00 2.50 - 3.49 1.50 - 2.49 1.00 - 1.49 


1 The 4-point scale for each component would remain the same for all measures (1-low, 4-high) except the value-added measure, which is calculated on a five-point scale. 

? For teachers without a Student Performance component, the Instructional Practice component will be 70% and the Professional Expectations component will be 30% of the Summative 
Appraisal Rating. 

3 Since all other measures have a 4-point scale, an adjustment has been made in the weights for the 5-point value-added scale. 


Adjustment to Value-Added Weights 


For Student Performance measures weighted as 20% of a Summative Rating, the 
maximum weighted score on a 1-4 scale is 0.8 


Weight (20%) 


Weighted 
Score 


+ 0.2 +0.2 +0.2 + 0.2 


Notice that the maximum weighted score, 0.8, is evenly divided between the 1- 
4 scale. Therefore, we should evenly distribute the maximum weighted score 
throughout a 1-5 scale: 

0.8+5=0.16 


i ose 


[Sa 2 SS 


+0.16 + 0.16 + 0.16 + 0.16 + 0.16 


For Value-Added measures weighted as 15%, the max score on a 1-4 scale is 0.6. Distributed evenly throughout a 1-5 sdale, the 
adjusted weight would be 12% (0.6+5=0.12). 


Source: TADS F&D Tool 
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APPENDIX C: 2014-2015 Student Performance Measures in Detail 


Student Performance Rating (SP): A composite metric used in teachers’ appraisal ratings when 
applicable. Teachers must have at least two of the following measures for SP to be applied to their overall 
summative rating: 
1) value-added (EVAAS) 
2) comparative growth (Norm-referenced test, such as lowa or TELPAS) 
3) students’ progress on districtwide assessments, pre-approved assessments, or appraiser- 
approved assessments 
4) students’ progress on districtwide, pre-approved, or appraiser-approved performance tasks or 
products 
5) student attainment on districtwide or appraiser-approved assessments 


SP ratings are on a scale of 1-4. If a teacher does not have at least two SP measures, the summative rating 
is based solely on an Instructional Practice (IP) rating and a Professional Expectations (PE) rating assigned 
by the appraiser. 


Value-Added (EVAAS): Value-added, or EVAAS, is one of the measures that may be used to calculate 
the SP rating. Value-added is a district-rated measure of the extent to which a student’s average growth 
meets, exceeds, or falls short of average growth of students in the district. It uses a student’s own academic 
performance across years, grades, and subjects as a basis for determining his/her average growth. EVAAS 
levels are on a scale of 1-5. 


EVAAS Levels, Gain Index, and Interpretation 


Level Gain Index Interpretation 

Level 5 2.00 or greater Significant evidence that students exceeded the growth standard 
Level 4 Between 1.00 and 2.00 | Moderate evidence that students exceeded the growth standard 
Level 3 Between -1.00 and 1.00 | Evidence that students met the growth standard 
Level 2 Between -2.00 and -1.00 | Moderate evidence that students did not meet the growth standard 
Level 1 Less than -2.00 Significant evidence that students did not meet the growth standard 


EVAAS value-added measures are calculated for teachers of students in grades 3-8 for reading, math, and 
language arts; for teachers of students in grades 4—8 for science and social studies; and for teachers of 
students enrolled in courses with the STAAR end-of-course (EOC) exams (English I, English II, Algebra |, 
Biology, and U.S. History). EVAAS uses both STAAR and NRT (such as Stanford/Aprenda and 
lowa/Logramos) test results to calculate growth measures for the following grades and subjects: 


EVAAS Assessments by Grade Level and Subject 


[Subjects | 3 | 4 | 5 | 6 {| 7 | 8 | 9 | 0 | 4 | 
|Math___| staan’ | staan’ | staan’ | staan’ | STAAR® | sTAAR® | Algebra! | None 


|Science_| None | NRT |STAAR| NAT | NRT | STAAR| Biology | None | None _| 


roca: None | NRT | NAT | NAT | NAT | STAAR | None None ae 
Siudies History 
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“Because of the changes in the 2014-2015 math curriculum, STAAR math results for grades 3-8 were not 
used for appraisal purposes in 2014-2015, per a School Board recommendation. 


Comparative Growth (CG): Comparative growth is also one of the measures that may be used to calculate 
a teacher’s SP rating. Comparative Growth measures the progress of a teacher's students on a given 
assessment compared to all other students within the same school district who start at the same test-score 
level. Comparative Growth relies on the use of standardized assessments in certain grades and subjects, 
and is computed using two consecutive years of students’ scores. 


Comparative Growth using the NRT assessments (such as lowa/Logramos) are only calculated for these 
grade levels and subjects: Grades 2, 3, 4, 5, 6, 7 and 8 Reading and Math; Grades 5 and 8 Science; Grade 
8 Social Studies; and Grade 2 Language Arts. Comparative Growth using the TELPAS assessment are 
calculated in grades 3-8. CG scores are placed on a scale of 1-4. 


Student Progress on district-wide, pre-approved, or appraiser-approved summative assessments: 
Student Progress is a student learning measure that uses summative assessments to measure how much 


content and skill students learned over the duration of a course or year, based on where they started the 
subject or course. Student Progress is an appraiser-approved rating of the extent to which students learned 
an ambitious and feasible amount of content and skills, taking into account students’ starting points. 


To measure Student Progress, teachers must create Goal Worksheets for two of the courses they teach 
and place students into appropriate starting points based on two pieces of evidence, such as past grades 
or past test scores. Once students have been placed into an appropriate starting group, which must be 
approved by the teacher's appraiser, they will receive a goal dependent upon which assessment is 
appropriate for that course. Assessment results are entered into a Results Worksheet either automatically 
or by the teacher. Once the Results Worksheets have been approved by the appraiser, a teacher will 
receive a Performance Level rating based on how many students achieved their goals. Performance Levels 
are on a scale of 1-4. 


Student Progress on district-wide, pre-approved, or appraiser-approved performance tasks or work 
products: The Student Progress process using appraiser-approved culminating performance tasks or work 


products mirrors the process for Student Progress on assessments. The only substantive difference is the 
type of summative assessment tool used. For example, in certain subjects, such as art, music, or foreign 
language, a culminating project or performance task might be more appropriate than, or used in conjunction 
with, a more traditional paper-pencil test. 


Student_Attainment_on_districtwide_ or appraiser-approved summative assessments: Student 
Attainment is a student learning measure that uses district-wide or appraiser-approved assessments to 


measure how many students performed at a target level, regardless of their starting points. Currently, 
Student Attainment applies only to Pre-K. 


Source: Student Performance Guidebook 2014-2015 
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APPENDIX D: State Accountability System 


2015 Accountability Manual 


Comparison of 2014 and 2015 Performance Index Criteria and Indicators for Non-AEA Districts and Campuses 


Student Achievement 


"Aggregated weighted score 


Index 1 Target: 55 


All Student Groups and all tests combined 


Performance standard: Phase-in 1 Level Il (Satisfactory) 


STAAR EOC Assessments (5 tests): 
o English | (reading and writing combined into single English |) 
o English II (reading and writing combined into single English II) 
o Algebra | 
o Biology 


English Language Learners (ELLs): 


English version: 

© Students in U.S. schools Year 1 excluded 

o Students in U.S. schools Years 2-4 included 
(ELL Progress Measure) 

© Students in U.S. schools Years 5+included 
(Phase-in 1 Level II) 

Spanish version: 

© Students in U.S. schools Year 1 excluded 

© Students in U.S. schools Years 2-4 included 
(Phase-in 1 Level II) 

o Students in U.S. schools Years 5+included (Phase-in 1 
Level Il} 


STAAR L evaluated in ELL Progress Measure 

Index 2 Target: Based on 5" percentile of Index 2 outcomes 
based on the 2014 performance results by campus type: 
elementary, middle, or high school. Targets for districts 
based on 5'" percentile of campus performance across 

all campus types. 


Ten student groups: All Students, seven racial/ethnic groups, 
Students with Disabilities, and ELL Students 


By subject: reading and mathematics 


o One point for each percentage of assessment results that 
meet or exceed progress 

o One additional point for each percentage of results that 
exceed progress 


HISD Research and Accountability 


Index 1 Target: 60 


All Student Groups and all tests combined 
o Grades 3-8 mathematics excluded 
o STAAR A and STAAR Alt 2 for all grades and 
subjects excluded 


No change 


No change 


No change 
English Language Learners (ELLs)*: 


No change 


Index 2 Target: Based on 5" percentile of Index 2 outcomes 
based on the 2015 performance results by campus type: 
elementary, middle, or high school. Targets for districts 
based on 5!" percentile of campus performance across 

all campus types. 

Ten student groups: All Students, seven racial/ethnic groups, 
Students with Disabilities, Current and Monitored ELLs 
Across all subjects: reading, writing, and mathematics 
(Algebra | only for available grades) 


o Grades 3-8 mathematics excluded 
o STAAR A and STAAR Alt 2 for all grades and 
subjects excluded 


No change 


STAAR and ELL Progress Measures 
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English Language Learners (ELLs): 


English version: 
© Students in U.S. schools Year 1 excluded 
o Students in U.S. schools Years 2+ included 


Spanish version: 
o Students in U.S. schools Year 1 excluded 
© Students in U.S. schools Years 2+included 


STAAR L evaluated in ELL Progress Measure 


Index 3 Targets 


o District: 
o Elementary: 


By Subject Area: reading, mathematics, writing, science, and 
social studies 


° Economically Disadvantaged 
ing Racial/Ethnic Student Groups 


Minimum Size Criteria for Racial/Ethnic Student Groups: 


1) Identify the Racial/Ethnic student groups that have 25 or more 
tests in reading/ELA and 25 or more tests in mathematics from 
the prior year 

2) Select the lowest performing student group(s) that meet the 
above minimum size based on prior year results for All 

__. Subjects. 


Points based on STAAR performance: 

o Phase-in Satisfactory Standard: 
One point for each percentage of tests at Phase-in 
Satisfactory Standard or above 

o Advanced Standard: 
One additional point for each percentage of tests at Advanced 
Standard 
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2015 Accountability Manual 


Current and Monitored ELLs*: 


No Change 


No change 


~~ By Subject Area: reading, Algebra |, writing, science, and 


social studies 

o Grades 3-8 mathematics excluded 

o STAARA and STAAR Alt 2 for all grades and 
subjects excluded 


No change 


No change 


No change 
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2015 Accountability Manual 


English Language Learners (ELLs): 


English version: 
© Students in U.S. schools Year 1 excluded 
© Students in U.S. schools Years 2- 4 included 
ELL Progress Measure (1 point); 
STAAR Final Level II (2 points) 
© Students in U.S. schools Years 5+ included 
Phase-in 1 Level II (1 point); 
STAAR Advanced Level III (2 points) 
Spanish version: 
© Students in U.S. schools Year 1 excluded 
© Students in U.S. schools Years 2- 4 included 
Phase-in 1 Level Il (one point); 
STAAR Advanced Level III (two points) 
© Students in U.S. schools Years 5+ included 
Phase-in 1 Level Il (one point); 
STAAR Advanced Level Ill (two points) 


STAAR L evaluated in ELL Progress Measure 


Index 4 Target: 

All Components 
o Districts: 57 (based on all four components)* 
o High Schools/K-12: 57 (based on all four components)* 
o Elementary/Middle School: n/a 


STAAR Only: 
o District: 13 
o Elementary: 12 
o Middle School: 13 
o High School/K-12: 21 


Based on four components: STAAR Final Level Il, Graduation 
Rate (or Dropout Rate), Graduation Diploma Plan, and College- 
Ready Graduates. 


If any of the four components are not available, districts and 
campuses are evaluated on the STAAR component only. 


STAAR Score: STAAR Percent Met Final Level Il on two or more 
STAAR subject-area tests for All Students and racial/ethnic 
student groups 


Students tested on one subject area only must meet the final 
Level II performance standard for that subject area. Similarly, 
students tested on only two subject areas must meet the final 
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English Language Learners (ELLs)*: 


No Change 


No change 


No change 


Based on four components: STAAR Final Level II, Graduation 
Rate (or Dropout Rate), Graduation Diploma Plan, and 
Postsecondary Readiness Indicator. 


If any of the four components are not available, districts and 
campuses are evaluated on the STAAR component only. 


o Grades 3-8 mathematics excluded 


o STAAR A and STAAR Alt 2 for all grades and 
subjects excluded 


No change 
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Graduation Score: Combined performance across 
graduation/dropout rates for: 
o Grade 9-12 Four-Year Graduation Rate for ten student 
groups; or 
o Grade 9-12 Five-Year Graduation Rate for ten student 
groups, whichever contributes the most points to the index 


Ten Student Groups: All Students and each racial/ethnic group 
_(seven groups), Students with Disabilities, and ELLs 


~~ Graduation Plan: RHSP/DAP Graduates based on Four-Year 


Longitudinal Cohort: All Students and racial/ethnic groups 


College-Ready Graduates: High school graduates from the 
2012-13 school year who met the college-ready criteria on the 
TAKS exit-level test, or the SAT test, or the ACT test in both ELA 
and mathematics. 


Weighting: Combine with equal weight (25%) the results of four | 


components if all four are available: 
o STAAR Final Level Il 
o Graduation Rate 
o Graduation Plan 
© College-Ready Graduates 


Substitute assessments for STAAR EOC tests are included 


English Language Learners (ELLs) 


English version: 

© Students in U.S. schools Year 1 excluded 

o Students in U.S. schools Years 2-4 excluded 

© Students in U.S. schools Years 5+ included (Final Level II) 
Spanish version: 

o Students in U.S. schools Year 1 excluded 

© Students in U.S. schools Years 2-4 included (Final Level II) 

o Students in U.S. schools Years 5+included (Final Level II 
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No change 


Postsecondary Component: Annual graduates who 
demonstrate postsecondary readiness in any one of three 
ways: 


© Meeting the college-ready criteria on the TAKS exit-level 
test, SAT test, or ACT test in both ELA and mathematics 
Earning credit for two advanced course/dual credit courses 


Enrolling in a coherent sequence of two or more career 
and technical education (CTE) courses as part of a four- 
year plan of study. 


Weighting: Combine with equal weight (25%) the results of four 
components if all four are available: 

o STAAR Final Level Il 

o Graduation Rate 

o Graduation Plan 

o Postsecondary Readiness Indicator 


No Change 
English Language Learners (ELLs)*: 


No change 


* See Appendix | for a detailed description of the inclusion policies for ELL students. 
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APPENDIX E: Tables 


Table 3. 2011-2012 through 2014-2015 Summative Rating Distribution by Campus and 


Teacher Characteristics 
Ineffective (N) Needs Improvement (N) Effective (N) Highly Effective (N) Totals (N) 


2011— 2012— 2013— 2014— 2011— 2012— 2013— 2014— 2011- 2012— 2013— 2014- 2011— 2012— 2013- 2014- 2011- 2012- 2013- 2014- 
2012 2013 2014 2015 2012 2013 2014 2015 2012 2013 2014 2015 2012 2013 2014 (2015 2012 2013 2014 2015 


School Level 
23% 18% 57% 58% 21% 100% 100% 100% 
(1285) | (1,079) (3,250) |(3,441) (1,256) (5,705) | (5,956) | (5,947) 
20% | 20% 54% | 55% 20% 100% | 100% | 100% 
(346) | (361) (937) |(1,005) (359) (1,737) | (1,816) | (1,810) 
12% | 12% 69% 67% 19% 100% 100% 100% 
High] (22) (271) | (280) (1,587) |(1,551) (453 (2,311) | (2,326) | (2,312) 
16% | 12% 58% 50% 37% 100% 100% 100% 
Combined (99) (79) (351) | (332) (246 (609) (670) (680) 
Total (N) 
IR Schoolst 
29% | 28% 57% 57% 9% 9% 100% 100% 100% 
IR (530) | (478) (1,027) | (968) (156) | (153 (1,802) | (1,700) | (1,932) 
17% 15% 60% 59% 21% | 24% 100% 100% 100% 
Met Standards (1471) | (1320) (5,098) |(5,357) (1,767) |(2,161) (8,560) | (9,063) | (8,807) 
Total (N) 
Index 1 Scorest 
42% 
Less than 25 (5) (1) 
52% 3% 
26 to 50 (365) (24) 
62% 14% 
51to 75 (3,327) (742) 
57% 33% 
Greater than 75 (2,615) (1,547) 
Total (N) 
Core Subject Teachers 
22% 19% 55% 55% 19% 
Core (1556) | (1,403) (3,829) |(4,013) (1,320) 
13% | 11% 68% 66% 18% 
Non-Core (445) | (396) (2,296) |(2,318) (603) 
Total (N) 
Critical Shortage Teachers 
18% | 16% 62% 63% 17% 18% 100% 
Critical Shortage (442) | (408) (1,533) |(1,556) (414) | (450) (2,489) 
20% 17% 58% 58% 19% | 23% 100% 
Non-Critical Shortage (1559) | (1,391) (4,592) |(4,775) (1,509) |(1,869) (8,286) 
Total (N) 
Years of Experience 
54% 54% 100% 
New Teacher (843) |(1,061) (1,970) 
60% 61% 100% 
1-5 Years| (1,721) |(1,983) (3,259) 
62% 60% 100% 
6-10 Years| (1,407) |(1,258) (2,107) 
59% 58% 100% 
11-20 Years| (1,338) |(1,291) (2,233) 


59% 61% 100% 
Over 20 Years) (736) | (737) (1,202) 


Total (N) 
Source: TADS Feedback and Development Tool; TADS Student Performance Tool; HISD PeopleSoft Rosters: 2011-2012 as of 04-16-2012; 2012-2013 as of 04-10-2013; 
2013-2014 as of 04-14-2014; 2014-2015 as of 05-15-2015. 
tAccountability ratings not available for school year 2011-2012. 


*98 teachers at Community Services, HCC Life Skills, EL DAEP, or with no school identifying information in HR Roster. Not included in school levels. 


? 108 teachers at schools without Index 1 Scores or no school identifying information in HR Roster. 
3 108 teachers at schools without accounta bility ratings or no school identifying information in HR Roster. 


#59 teachers without HR Roster identifying information. 
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Table 4. 2011-2012 through 2014-2015 Instructional Practice (IP) Rating Distribution by Campus 
and Teacher Characteristics 


IP Level 1 (N) IP Level 2 (N) IP Level 3 (N) IP Level 4 (N) Totals (N) 


2011— 2012-— 2013— 2014— 2011— 2012- 2013— 2014— 2011- 2012- 2013- 2014- 2011— 2012- 2013- 2014- 2011- 2012- 2013- 2014— 
2012 2013 2014 2015 2012 2013 2014 2015 2012 2013 2014 2015 2012 2013 2014 2015 2012 2013 2014 2015 


64% | 65% 
(3,629) | (3857) 
66% | 65% 
(1,142) | (1175) 
69% | 67% 


19% 
936) |(1,136) 
17% | 16% | 16% | 18% 
279) | (286) | (325) 
19% | 19% | 19% | 23% 
(1,590) | (1560) 430) | (452) | (522) (2,311) | (2,326) | (2,312) 
65% | 53% 39% 100% | 100% | 100% 
(397) | (357) (258) (609) | (670) | (680) 


100% | 100% | 100% 
(5,705) | (5,956) | (5,947) 
100% | 100% | 100% 
(1,737) | (1,816) | (1,810) 
100% | 100% | 100% 


Combined 


Total 


24% | 25% 64% | 62% 9% | 9% 100% 100% 
(427) | (432) (1,162) | (1047) 164) | (161) | (151) (1,802) (1,932) 
14% | 12% 65% | 65% 19% | 22% | 25% 100% | 100% | 100% 
(1,225) | (1,051) (5,596) | (5899) (1,625) |(1,971) | (2,166) (8,560) (8,807) 


80% 0% | 0% 0% 
(44) (0) (0) (0) (0) 
59% 9% | 4% | 6% 100% | 100% | 100% 
(238) (38) | (25) | (74) - (404) | (703) | (1,292) 
67% 10% | 13% | 16% 100% | 100% | 100% 
(3,605) (527) | (698) | (940) | - | (5,366) | (5,406) | (5,992) 
63% 27% | 30% | 38% 100% 
(2,853) (1,220) |(1,407) | (1,303) (3,455) 


17% 64% 100% 
(1,207) (4,462) (8,410) 
13% 68% 100% 
(445) (2,296) (2,378) 


16% | 14% 67% 15% | 17% | 20% 100% 
(396) | (356) (1,659) (358) | (413) | (829) (4,081) 
16% | 14% 65% 18% | 21% | 22% 100% 
(1,256) | (1,129) (5,099) (1,431) |(1,724) | (1,493) (6,707) 


100% 100% 
(1,970) | (1,245) 
100% 100% 
(3,259) | (3,077) 
100% 100% 
6-10 Years (2,233) | (2,188) 
100% 100% 
11-20 Years (2,107) | (2,623) 
100% 100% 
Over 20 Years (1,202) | (1,655) 
Total 
Source: TADS Feedback and Development Tool; TADS Student Performance Tool; HISD PeopleSoft Rosters: 2011-2012 as of 04-16-2012; 2012-2013 as of 04-10-2013; 2013-2014 

as of 04-14-2014; 2014-2015 as of 05-15-2015. 
*n<5 
tAccountability ratings not available for school year 2011-2012. 


+98 teachers at Community Services, HCC Life Skills, EL DAEP, or with no school identifying information in HR Roster. Not included in school levels. 
? 108 teachers at schools without accountability ratings or no school identifying information in HR Roster. 
3 108 teachers at schools without Index 1 Scores or no school identifying information in HR Roster. 


#59 teachers without HR Roster identifying information. 
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Table 7. 2011-2012 through 2014-2015 Student Performance (SP) Rating Distribution by Campus 
and Teacher Characteristics 


SP Level 2 (N) 
2012— 2013— 2014— 2012— 2013— 2014— 
2013 2014 2015 2013 2014 2015 


SP Level 1 (N) 


SP Level 3 (N) 


SP Level 4 (N) 


Totals (N) 


2012— 
2013 


2013— 2014—- 2012- 


2014 


39% 


2015 


2013 


2013-— 
2014 


2014—  2012- 


2015 


2013 


2013- 
2014 


100% 


2014— 
2015 


High 


Combined 


Total 


33% 
(165) 


(1,157) | (940) (3,003) | (3,122) 

40% | 27% 100% | 100% 

(327) | (364) | (197) (851) | (916) | (721) 
0% | 27% | 16% 0% | 100% | 100% 
(0) (7) (78) (0) (26) | (473) 
38% | 37% | 24% 100% | 100% | 100% 


(110) 


33% 
(161) 


10% 
(51) 


(297) 


100% 
(493) 


Less than 25 


13% 
(483) 


39% 
(1,477) 


32% 
(1,215) 


100% 


(3,748) 


100% 
(5) 


26 to 50} 


100% 
(213) 


100% 
(2,113) 


39% 
(1,636) 


30% 
(1,260) 


100% 
(1,909) 


100% 
(4,233) 


21% 
(114) 


0% 


35% 
(187) 


78% 


31% 
(168) 


100% 
(9) 


100% 
(542) 


Non-Critical Shortage 
Total 


14% 
(534) 


24% 
(208) 


39% 
(1,451) 


30% 
(1,099) 


100% 
(3,700) 


100% 
(862) 


14% 
(197) 


100% 
(1,380) 


13% 
(113) 


100% 
(872) 


12% 
(92) 


100% 
(759) 


Over 20 Years 
Total 


10% 
(38) 


100% 
(369) 


Source: TADS Feedback and Development Tool; TADS Student Performance Tool; HISD PeopleSoft Rosters: 2012—2013 as of 04-10-2013; 2013-2014 
as of 04-14-2014; 2014-2015 as of 05-15-2015. 
* Six teachers with SP missing from HR Roster file. 
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